Web development
As mentioned in an earlier posting, I will redesign my website to make it more userfriendly and more easy for me to update. A website that is not updated tend not to be very userfriendly.
As will be very obvious from my questions, webtechnology and databases are not my field of expertise. Just as in music, too many of those who are trying to explain tend to take some basic knowledge for granted, and do not explain the very basic concepts. This is why I am posting these questions, hoping to get some feed back from those of you who know these techonolgies. I need to test if my understanding is correct and get i corrected when it is needed.
I am using three different databases, CATraxx, BookCAT and CatVids to keep track of my CDs, books and videos. So far I have been using them for my own books, CDs and videos. (They are among my favourite programs, highly recommended!) But I want to use the same programs as a kind of "back office organizer" for information I put on the web. There are many reasons for that. One obvious reason is that I have been using these programs for years, I know them and I like them, and I still have not seen anything that come close. They can do more than you ever will try, and they are flexible. I can use Custom fields to register guitar tunings, keys, chord progressions, etc. This is not the kind of information a normal collector will be interested in, and you need a flexible program to be able to include this. I want to use the same program to organize the books I have in my bookshelves, as well as well as the books I put in my "book store". It means that I do not have to learn another program, and it will be easy to make more information available on the net. The same goes for CDs and videos.
These programs are based on MS Access. The hosting service from my ISP is based on Microsoft, with asp and asp.net, and MS SQL database. What I am hoping to do, is to transfer the data from the Access databases to MS SQL. And here comes one of my questions on "what you always wanted to know about databases, but where afraid to ask":
Will it at least to some extent be correct to say that databases have three major components: A user interface used to enter and process the data that goes into the tables, the tables where all the data is stored, and then a component used to extract and present the data. My understanding is that many of the fancy scripts that go into the making of a database is in the "data entry module". The result of this process is a number of tables with "static" data. I am not saying that the tables as such are static, but what is stored in the tables are basically static text and numbers, as well as binary files (pictures, formatted text, etc). There may be parameters defining what kind of data that will be allowed, but the data is not processed. (It is a matter of definition when it comes to data such as dates that are stored as a number, but presented in a date format.) The "Query" or "search" component search, combine and present data from the tables.
My idea is to use my favourite databases to organize the data, export the tables to the SQL server, and then add some procedures to extract the information from the SQL tables and present them on the web. I do not need all the search and presentation facilites in CATraxx, BookCAT and CatVids on the net, and I do not need the data entry and data manipulation facilities. But I have not made up my mind on how I will present this. I will probably start with the same sorting options as today (artist, genre, level etc), with not too detailed information. I will include basic information, internal links to pages on my site that are relevant for their guitar playing (when applicable), and include data on books, CDs, videos, instruments and other equipment. I hope that it will be more flexible and offer more options than what I have today, and that it will open up for further development. An important question for me is if this is a workable solution, and if there are ways to export data tables from Access to MS SQL that are not too complcated. (To export the data in XML format is an option. CATraxx, BookCAT and CatVids have good export procedures for data on books/albums and tracks/content, but unfortunatly there are no procedure for exporting the data on artists/persons. So for at least some of the information, there seem to be no way to avoid exporting Access-tables.)
If I manage to get the data into the SQL tables, the next challenge will be to present the data. As I am thinking now, I will probably go for an XML-based solution, based on XSL-stylesheets. CATraxx, BookCAT and CatVids all have many XSL-templates which I think I can start from. But I need to learn a little more about XSL. I wish I could find a WYSIWYG XSL-editor. When I am working with presentation, I prefer to see what it actually looks like while I am working. So far I have only found text-based editors, and I find it hard to imagine what all these lines of code actually will look like.
The rest of what I am planning seem to be more straightforward, at least there are many products available that promise to do the job. I will add some blogging software, better linking management and maybe a little bit more.
Probably to the disappointment to some of you, I will also develop the advertising a bit more. I am signing up with a few more affiliate programs, and will probably add some software to manage advertising. Geotargeting is the most important feature. I does not make sense to advertise in Europe a supplier that will only deliver in US (like MusiciansFriend), or advertise European services in US. It is the little stream of money generated from sales through the affiliate links cover the expenses related to maintaining the site (as well as giving some pocket money to spend on music ...). But I will only pick products and services that I like and use myself. There will be no online casinos, no "viruses" like adware, no pop-ups, etc. I am buying from Amazon US and Amazon UK, as well as from SheetmusicPlus and MusicRoom. I have been using CATraxx, BookCAT and CatVids for years, and Earope is still my favourite ear training program. I would have been buying from MusiciansFriend if they had shipped to Europe, I am using the Kelkoo service every time I am looking for a flight or any other product or service at a good price, I enjoy music on my iPod, I am writing this on my Dell laptop, etc. These are the kind of products and services you will see advertised on my site. In all advertising there is a kind of endorsment.
If some of you could answer or comment some of the questions raised about webdevelopment, I would appreciate either comments in this blog or an e-mail.
PS:
I sometimes wonder what is the secret of the small Norwegian town Moss. It is a small town 5o km south of Oslo, previously most know for its pulp factory which created a peculiar smell over the town. I found the programs CATraxx, BookCAT and CatVids when surfing the net to find a good program for CD organizing. I tried several, and decided to go for CATraxx. Some time later, I realized that this program is developed by a small company (my understanding is that is is a one man company) in this little town. My favourite reference for web technology is w3school at http://www.w3schools.com/. After having used w3school for a while, I realized that this service is run by another small company in the same little town. It is also the home of Helly Hansen, one of the few Norwegian brand names known globally in the consumer market. But despite excellent software and web development and internationally orientet business: They have not been able to make a webpresentation of the town in English. So I include a link to Galleri F15 instead - one of the leadning contemporary art galleries in Norway.
As will be very obvious from my questions, webtechnology and databases are not my field of expertise. Just as in music, too many of those who are trying to explain tend to take some basic knowledge for granted, and do not explain the very basic concepts. This is why I am posting these questions, hoping to get some feed back from those of you who know these techonolgies. I need to test if my understanding is correct and get i corrected when it is needed.
I am using three different databases, CATraxx, BookCAT and CatVids to keep track of my CDs, books and videos. So far I have been using them for my own books, CDs and videos. (They are among my favourite programs, highly recommended!) But I want to use the same programs as a kind of "back office organizer" for information I put on the web. There are many reasons for that. One obvious reason is that I have been using these programs for years, I know them and I like them, and I still have not seen anything that come close. They can do more than you ever will try, and they are flexible. I can use Custom fields to register guitar tunings, keys, chord progressions, etc. This is not the kind of information a normal collector will be interested in, and you need a flexible program to be able to include this. I want to use the same program to organize the books I have in my bookshelves, as well as well as the books I put in my "book store". It means that I do not have to learn another program, and it will be easy to make more information available on the net. The same goes for CDs and videos.
These programs are based on MS Access. The hosting service from my ISP is based on Microsoft, with asp and asp.net, and MS SQL database. What I am hoping to do, is to transfer the data from the Access databases to MS SQL. And here comes one of my questions on "what you always wanted to know about databases, but where afraid to ask":
Will it at least to some extent be correct to say that databases have three major components: A user interface used to enter and process the data that goes into the tables, the tables where all the data is stored, and then a component used to extract and present the data. My understanding is that many of the fancy scripts that go into the making of a database is in the "data entry module". The result of this process is a number of tables with "static" data. I am not saying that the tables as such are static, but what is stored in the tables are basically static text and numbers, as well as binary files (pictures, formatted text, etc). There may be parameters defining what kind of data that will be allowed, but the data is not processed. (It is a matter of definition when it comes to data such as dates that are stored as a number, but presented in a date format.) The "Query" or "search" component search, combine and present data from the tables.
My idea is to use my favourite databases to organize the data, export the tables to the SQL server, and then add some procedures to extract the information from the SQL tables and present them on the web. I do not need all the search and presentation facilites in CATraxx, BookCAT and CatVids on the net, and I do not need the data entry and data manipulation facilities. But I have not made up my mind on how I will present this. I will probably start with the same sorting options as today (artist, genre, level etc), with not too detailed information. I will include basic information, internal links to pages on my site that are relevant for their guitar playing (when applicable), and include data on books, CDs, videos, instruments and other equipment. I hope that it will be more flexible and offer more options than what I have today, and that it will open up for further development. An important question for me is if this is a workable solution, and if there are ways to export data tables from Access to MS SQL that are not too complcated. (To export the data in XML format is an option. CATraxx, BookCAT and CatVids have good export procedures for data on books/albums and tracks/content, but unfortunatly there are no procedure for exporting the data on artists/persons. So for at least some of the information, there seem to be no way to avoid exporting Access-tables.)
If I manage to get the data into the SQL tables, the next challenge will be to present the data. As I am thinking now, I will probably go for an XML-based solution, based on XSL-stylesheets. CATraxx, BookCAT and CatVids all have many XSL-templates which I think I can start from. But I need to learn a little more about XSL. I wish I could find a WYSIWYG XSL-editor. When I am working with presentation, I prefer to see what it actually looks like while I am working. So far I have only found text-based editors, and I find it hard to imagine what all these lines of code actually will look like.
The rest of what I am planning seem to be more straightforward, at least there are many products available that promise to do the job. I will add some blogging software, better linking management and maybe a little bit more.
Probably to the disappointment to some of you, I will also develop the advertising a bit more. I am signing up with a few more affiliate programs, and will probably add some software to manage advertising. Geotargeting is the most important feature. I does not make sense to advertise in Europe a supplier that will only deliver in US (like MusiciansFriend), or advertise European services in US. It is the little stream of money generated from sales through the affiliate links cover the expenses related to maintaining the site (as well as giving some pocket money to spend on music ...). But I will only pick products and services that I like and use myself. There will be no online casinos, no "viruses" like adware, no pop-ups, etc. I am buying from Amazon US and Amazon UK, as well as from SheetmusicPlus and MusicRoom. I have been using CATraxx, BookCAT and CatVids for years, and Earope is still my favourite ear training program. I would have been buying from MusiciansFriend if they had shipped to Europe, I am using the Kelkoo service every time I am looking for a flight or any other product or service at a good price, I enjoy music on my iPod, I am writing this on my Dell laptop, etc. These are the kind of products and services you will see advertised on my site. In all advertising there is a kind of endorsment.
If some of you could answer or comment some of the questions raised about webdevelopment, I would appreciate either comments in this blog or an e-mail.
PS:
I sometimes wonder what is the secret of the small Norwegian town Moss. It is a small town 5o km south of Oslo, previously most know for its pulp factory which created a peculiar smell over the town. I found the programs CATraxx, BookCAT and CatVids when surfing the net to find a good program for CD organizing. I tried several, and decided to go for CATraxx. Some time later, I realized that this program is developed by a small company (my understanding is that is is a one man company) in this little town. My favourite reference for web technology is w3school at http://www.w3schools.com/. After having used w3school for a while, I realized that this service is run by another small company in the same little town. It is also the home of Helly Hansen, one of the few Norwegian brand names known globally in the consumer market. But despite excellent software and web development and internationally orientet business: They have not been able to make a webpresentation of the town in English. So I include a link to Galleri F15 instead - one of the leadning contemporary art galleries in Norway.
posted by Olav Torvund at Wednesday, November 30, 2005
11 comments
